™ United States Patent and Trademark Office 
ill ^ _ ___- — — ________ ______ _____ 



UNITED STATES DEPARTMENT OF COMMERCE 
United States Patent and Trademark Office 
Address: COMMISSIONER FOR PATENTS 
P.O. Box 1450 

Alexandria, Virginia 22313-1450 
www.uspto.gov 



APPLICATION NO. 


FILING DATE 


FIRST NAMED INVENTOR 


ATTORNEY DOCKET NO. 


CONFIRMATION NO. 


09/521,252 


03/08/2000 


Dar-Shyang Lee 


015358-006300US 


1607 



7590 01/06/2006 

Townsend and Townsend and Crew LLp 
Two Embarcadero Center 8th Floor 
San Francisco, CA 941 11-3834 



EXAMINER 



BASHORE, WILLIAM L 



ART UNIT 



PAPER NUMBER 



2176 

DATE MAILED: 01/06/2006 



Please find below and/or attached an Office communication concerning this application or proceeding. 



PTO-90C (Rev. 10/03) 





Application No. 


Applicant(s) 


KsUlUx? MCuOil OUfilitiat y 


09/521,252 


LEE ETAL 


Examiner 


Art Unit 






William L. Bashore 


2176 





- The MAILING DATE of this communication appears on the cover sheet with the correspondence address 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 . 1 36(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )^ Responsive to communication(s) filed on 27 October 2005 . 
2a)D This action is FINAL. 2b)^ This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quay/e, 1935 CD. 1 1 , 453 O.G. 213. 

Disposition of Claims 

4) ^ Claim(s) 1-49 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) ^ Claim(s) 1-49 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) Q Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10)D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121 (d). 
11 )□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12)D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
a)D All b)D Some * c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2. Q Certified copies of the priority documents have been received in Application No. . 

3. Q Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 



Attachment(s) 

1 ) ^ Notice of References Cited (PTO-892) 

2) EH Notice of Draftsperson's Patent Drawing Review (PTO-948) 

3) Information Disclosure Statement(s) (PTO-1449 or PTO/SB/08) 
Paper No(s)/Mail Date 10/18/05 . 



4) □ Interview Summary (PTO-413) 

Paper No(s)/Mail Date. . 

5) □ Notice of Informal Patent Application (PTO-152) 

6) □ Other: . 



U.S. Patent and Trademark Office 
PTOL-326 (Rev. 7-05) 



Office Action Summary 



Part of Paper No./Mail Date 20060103 



Application/Control Number: 09/521,252 
Art Unit: 2176 



Page 2 



DETAILED ACTION 

1 . This action is responsive to communications: RCE/amendment filed 10/27/2005, to the original 
application filed 3/8/2000. IDS filed 3/8/2000, 6/18/2000, 1/25/2005, 1/31/2005, and 10/18/2005. 

Continued Examination Under 37 CFR LI 14 

2. A request for continued examination under 37 CFR 1.114, including the fee set forth in 37 CFR 1 . 1 7(e), 
was filed in this application after final rejection. Since this application is eligible for continued examination 
under 37 CFR 1.1 14, and the fee set forth in 37 CFR 1.17(e) has been timely paid, the finality of the previous 
Office action has been withdrawn pursuant to 37 CFR 1.1 14. Applicant's submission filed on 10/27/2005 has 
been entered. 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness rejections set 
forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in section 102 of this title, if the 
differences between the subject matter sought to be patented and the prior art are such that the subject matteT as a whole would have been 
obvious at the time the invention was made to a person having ordinary skill in the art to which said subject matter pertains. Patentability shall 
not be negatived by the manner in which the invention was made. 

4. Claims 1-49 are rejected under 35 U.S.C. 103(a) as being unpatentable over Moran et al. 
(hereinafter Moran), U.S. Patent No. 5,717,879 issued February 1998 (cited on Applicant's IDS), in view 
of Ludwig et al. (hereinafter Ludwig), U.S. Patent No. 5,802,294 issued September 1998, and further in 
view of Adler et al. (hereinafter Adler), U.S. Patent No. 6,249,765 issued June 2001. 

in regard to independent claim 1, Moran teaches management of meeting related information (i.e. 
recording of meeting information) (Moran Abstract, Figures 12-14; compare with claim 1 *A method for 
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managing information during a meeting comprising steps of). 

Moran teaches recording/replay of records of a meeting (Moran Abstract, column 3 lines 33-39, Figures 
11-14; compare with claim 1 "recording activities among participants during said meeting to produce recording 
meeting data:"). 

Moran teaches identifying a participant directive via accessing meeting data via button events initiated 
by participants during an ongoing meeting, the event indicators being color coded to identify a participant, with 
each button event indicative of a directive, as well as buttons and notes (i.e. a service - indicating a participant 
who feels something significant is being discussed) (Moran column 22 lines 1-20, Figure 13). Moran does not 
specifically teach identifying said directive via "analyzing said recorded meeting data.... while said meeting is 
ongoing" (although participants can contribute to Moran 's Figure 13 during a meeting, Moran is moot regarding 
actually showing Figure 13 to participants for analysis during an ongoing meeting). However, Ludwig teaches a 
teleconferencing system comprising a video mosaic of each participant (Ludwig, Abstract, Figure 8A to 8C — 
also note button "Whiteboard" within Figure 8B). Ludwig's shows multiple participants in a common interface. 
During a teleconference meeting, said participants are commonly shown to all other participating callers, 
therefore Ludwig displays an interface of running meeting data for analysis. It is noted that Ludwig's invention 
can utilize whiteboard, and annotation capabilities, and sessions can be recorded (Ludwig column 3 lines 1-10). 
It would have been obvious to one of ordinary skill in the art at the time of the invention to apply Ludwig to 
Moran, providing Moran the benefit of showing ongoing meeting data (Figure 13) to participants as a meeting is 
ongoing, for analyzing purposes (compare with claim 1 "analyzing said recorded meeting data... by a 
participant of said meeting' 1 ). 

Moran teaches button events initiated by participants during an ongoing meeting, the event indicators 
being color coded to identify a participant, with each button event indicative of a directive (i.e. indicating a 
participant who feels something significant is being discussed), resulting in addition of the event to the 
recording (Moran column 22 lines 12-20, Figures 11, 13). Moran also teaches Figure 13 item 1302, which is an 
added note associated with a speaker (see also Moran column 22 lines 8-12) (compare with claim 1 "in response 
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to identifying said participants... during said meeting. "). 

Moran does not specifically teach analyzing recorded meeting data "absent direct human intervention" 
to identify contained cues. However, Adler teaches an automatic (without direct human intervention) method of 
extracting pertinent data from audio messages (i.e. voicemail, etc.) (Adler Abstract). Adler's invention 
automatically analyzes a recorded message for cue words (i.e. name, number, etc.) and extracts the related data, 
such as a phone number from said message. The data alone can then be played back, or used as indices within a 
database (pointers to the data are stored with said message) (Adler Abstract, column 15 lines 12-23, column 16 
lines 3-18, 25-30, 50-62, column 17 lines 30-37, 50-59). Since it is typical for a user to leave his/her telephone 
number (or name, etc.) as a cue for the recipient to make note of, this teaching can be fairly interpreted as cues 
intended as participant directives. It would have been obvious to one of ordinary skill in the art at the time of the 
invention to apply Adler to Moran, providing Moran the benefit of automatic event indicators without 
distracting the meeting participants. 

In regard to dependent claim 2, Moran teaches tracks 1 122-1 124, which are starting points of (textual 
notes of participants. Since said notes are part of the recorded meeting, said text is analyzed (as explained 
above) in association with a button press (track 1 124) (see Moran column 22 lines 8-25). 

In regard to dependent claim 3, Moran teaches both audio and video (Moran column 21 lines 25-34, 
column 22 lines 20-25, Figures 1 1-14). 

In regard to dependent claim 4, Moran teaches adding notes (a form of editing/manipulation) to 
recorded meeting data (Moran Figure 13 item 1302) 
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In regard to dependent claim 5, Moran teaches accessing recorded meeting data via button events 
initiated by participants during an ongoing meeting, the event indicators being color coded to identify a 
participant, with each button event indicative of a directive (i.e. indicating a participant who feels something 
significant is being discussed) (Moran column 22 lines 12-20). 

In regard to dependent claim 6, Moran teaches a meeting using human participants, audio, video, 
textual notes, and prepared material via a projected medium (Moran column 13 lines 1-1 1,18-20, Figure 13). 

In regard to dependent claim 7, Moran teaches accessing recorded meeting data via button events 
initiated by participants during an ongoing meeting, the event indicators being color coded to identify each 
participant, with each button event indicative of a directive (i.e. indicating a participant who feels something 
significant is being discussed — adding a note, accordingly) (Moran column 22 lines 12-20, Figure 13). 

In regard to dependent claim 8, Moran teaches a meeting player for recording locations of 
participants, said locations recorded as part of the recorded media to be analyzed for adding directives, 
accordingly (as explained in the rejection of instant claim 1, above) (Moran Figure 14). 

In regard to dependent claim 9, Moran teaches a meeting player for recording locations of 
participants, said locations recorded as part of the recorded media to be analyzed for adding directives, 
accordingly (as explained in the rejection of instant claim 1, above), each participant is shown in a different 
geographic location relative to one another (Moran Figure 14). 
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In regard to independent claim 10, Moran teaches management of meeting related information (i.e. 
recording of meeting information between participants) (Moran Abstract, Figures 12-14; compare with claim 10 
"A method for managing information services during a meeting involving two or more participants, comprising 
steps of). 

Moran teaches recording/replay of records of a meeting utilizing a (continuous timestream) of video, 
said video can comprise a person (i.e. a participant) standing to speak, said timestream enabled for an entire 
meeting (Moran Abstract, column 3 lines 33-39, column 22 lines 20-24 Figure II item 1 125). Moran does not 
specifically teach said video of a participant as continuously recorded for the duration of said meeting. However, 
Ludwig teaches a teleconferencing system comprising a video mosaic of a live conference call, with a video of 
each participant presented for the duration of said call (Ludwig, Abstract, Figure 8B, 8C — also note button 
"Whiteboard" within Figure 8B). It is noted that Ludwig's invention can utilize whiteboard, and annotation 
capabilities, and sessions can be recorded (Ludwig column 3 lines 1-10). It would have been obvious to one of 
ordinary skill in the art at the time of the invention to apply Ludwig to Moran, providing Moran the benefit of a 
complete video record of each participant for reference purposes (compare the above to claim 10 ''producing a 
continuous video recording of at least one of said participants for the duration of said meeting*'). 

Moran teaches producing an audio timeline for each participant for the duration of a meeting (Moran 
Figure 1 1 items 1 1 19, 1 120, 1 121; compare with claim 10 "producing a continuous audio recording of at least 

one of said participants for the duration of said meeting "). 

Moran teaches storing video/audio streams (Moran column 12 lines 45-50, column 31 lines 4448; 
compare with claim 10 "storing said video and said audio recordings in a data store"). 

Moran teaches identifying a participant directive via accessing meeting data via button events initiated 
by participants during an ongoing meeting, the event indicators being color coded to identify a participant, with 
each button event indicative of a directive, as well as buttons and notes (i.e. a service - indicating a participant 
who feels something significant is being discussed) (Moran column 22 lines 1-20, Figure 13). Moran does not 
specifically teach identifying said directive based on video/audio data (although participants can contribute to 
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Moran' s Figure 13 during a meeting, Moran is moot regarding actually showing Figure 13 to participants for 
analysis during an ongoing meeting). However, Ludwig teaches a teleconferencing system comprising a video 
mosaic of each participant (Ludwig, Abstract, Figure 8A to 8C — also note button "Whiteboard" within Figure 
8B). Ludwig's shows multiple participants in a common interface. During a teleconference meeting, said 
participants are commonly shown to all other participating callers, therefore Ludwig displays an interface of 
running meeting data for analysis. It would have been obvious to one of ordinary skill in the art at the time of 
the invention to apply Ludwig to Moran, providing Moran the benefit of showing ongoing meeting data (Figure 
13) to participants as a meeting is ongoing, as well as the benefit of recording comments based upon live 
recorded video feeds from participants in other areas (compare with claim 10 "analyzing either or both of said 
video recording and said audio recording.... detect a participant directive", and "providing one or more 
information-related services based on said participant directive"). 

Moran teaches button events initiated by participants during an ongoing meeting, the event 
indicator being color coded to identify a participant, with each button event indicative of a directive (i.e. 
indicating a participant who feels something significant is being discussed, as indicated via gestures and 
utterances of a participant), resulting in addition of the event to the recording. Moran also teaches Figure 13 item 
1302, which is an added note associated with a speaker (see also Moran column 22 lines 8-12) (Moran column 
22 lines 12-20, Figures 11,13 compare with claim 10 "thereby providing information... during said meeting"). 

Moran does not specifically teach analyzing recorded meeting data "absent direct human intervention" 
to identify contained cues. However, Adler teaches an automatic (without direct human intervention) method of 
extracting pertinent data from audio messages (i.e. voicemail, etc.) (Adler Abstract). Adler's invention 
automatically analyzes a recorded message for cue words (i.e. name, number, etc.) and extracts the related data, 
such as a phone number from said message. The data alone can then be played back, or used as indices within a 
database (pointers to the data are stored with said message) (Adler Abstract, column 15 lines 12-23, column 16 
lines 3-18, 25-30, 50-62, column 17 lines 30-37, 50-59). Since it is typical for a user to leave his/her telephone 
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number (or name, etc.) as a cue for the recipient to make note of, this teaching can be fairly interpreted as cues 
intended as participant directives. It would have been obvious to one of ordinary skill in the art at the time of the 
invention to apply Adler to Moran, providing Moran the benefit of automatic event indicators without 
distracting the meeting participants. 

In regard to dependent claim 11, Moran teaches an input (i.e. recording/capturing) device (Moran 
column 6 lines 35-39, column 13 lines 1-11). 

In regard to dependent claim 12, Moran does not specifically teach detecting directives based upon 
text in video or audio. However. Ludwig teaches teleconferencing whereby a textual note is added to a 
participant's data feed (Ludwig Figure 28 — lower left window). It would have been obvious to one of ordinary 
skill in the art at the time of the invention to apply Ludwig to Moran, providing Moran the benefit of 
participants reacting to textual data for effect. 

In regard to dependent claim 13, Moran teaches accessing recorded meeting data via button events 
initiated by participants during an ongoing meeting, the event indicators being color coded to identify a 
participant, with each button event indicative of a directive (i.e. a service indicating a participant who feels 
something significant is being discussed — based upon the context of said meeting) (Moran column 22 lines 12- 
20). 

In regard to dependent claim 14, Moran teaches accessing recorded meeting data via button events 
initiated by participants during an ongoing meeting, the event indicators being color coded to identify a 
participant, with each button event indicative of a directive (i.e. a service - indicating a participant who feels 
something significant is being discussed). The note is attached to the recorded meeting accordingly, and 
information is retrieved to be displayed on an editor, utilizing the continuous timelines, accordingly (Moran 
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column 22 lines 12-20, Figures 11-14). 

In regard to dependent claims 15-17, Moran teaches accessing recorded meeting data via (input) 
button events initiated by participants during an ongoing meeting, the event indicators being color coded to 
identify a participant, with each button event indicative of a directive (i.e. a service - indicating a participant 
who feels something significant is being discussed). The note is attached to the recorded meeting accordingly 
and information is retrieved to be displayed for users, accordingly (Moran column 22 lines 12-20, Figures 11- 
14). 

In regard to dependent claims 18-19, Moran teaches accessing, editing, and assimilating information 
(Moran Figure 8, 11-14, especially Figure 13 item 1302). Moran does not specifically teach establishing a new 
participant, transmitting/receiving messages, and accessing various networks. However, Ludwig teaches a 
teleconferencing system utilizing resume, hang up, and adjourn buttons, as well as electronic mail and various 
networks (i.e. LAN/WAN etc.) (Ludwig Abstract, Figures 2 A, 2B, SA— SC, column 15 lines 17-31). It would 
have been obvious to one of ordinary skill in the art at the time of the invention to apply Ludwig to Moran, 
providing Moran the benefit of teleconferencing a meeting. 

In regard to dependent claims 20-21, Moran does not specifically teach permissions, as claimed. 
However, Moran teaches accessing recorded meeting data via button events initiated by participants during an 
ongoing meeting, the event indicators being color coded to identify each participant, with each button event 
indicative of a directive (i.e. a service - indicating a participant who feels something significant is being 
discussed (Moran column 22 lines 12-20), providing the claimed equivalent of permissions, since (implicit) 
permission is granted to assign a certain colored button for use by a specific participant. It would have been 
obvious to one of ordinary skill in the art at the time of the invention to interpret Moran in this fashion, 
providing Moran the benefit of increased security (and organization) to its recorded meeting. 
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In regard to dependent claim 22, Moran teaches a meeting player showing participants in distinct 
geographic locations (Moran Figure 14). 

In regard to independent claim 23, claim 23 reflects the system comprising computer executable 
instructions used for performing the method as claimed in claim 10, and is rejected along the same rationale 

In regard to dependent claims 24, 25, claims 24, 25 reflect the system comprising computer 
executable instructions used for performing the method as claimed in claim 14, and are rejected along the same 
rationale. 

In regard to dependent claims 26, 27, 28, 29, 30, 31,32, claims 26, 27, 28, 29, 30, 31, 32 reflect the 
system comprising computer executable instructions used for performing the method as claimed in claims 121, 
22, 18, and are rejected along the same rationale. 

In regard to independent claim 33, claim 33 incorporates substantially similar subject matter as 
claimed in claims 10, 12, 14, and is rejected along the same rationale. 

In regard to dependent claims 34, 35,36,37, claims 34, 35, 36, 37 incorporate substantially similar 
subject matter as claimed in claims 10, 14, 17 and are rejected along the same rationale. 

In regard to dependent claims 38-41, claims 38-41 incorporate substantially similar subject matter as 
claimed in claims 10, 20-22, and are rejected along the same rationale. 
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In regard to independent claim 42, claim 42 reflects the system comprising computer executable 
instructions used for performing the method as claimed in claims 10, 12. 14, 15, and in further view of the 
following, is rejected along the same rationale. 

Moran teaches storage of audio, image, and textual related information (Moran Figures 11-14). 
Moran does not specifically teach real-time video and audio. However, Ludwig teaches a 
teleconferencing system, said system used in real-time (Ludwig Abstract, Figures 8 A - 8C). It would have been 
obvious to one of ordinary skill in the art at the time of the invention to apply Ludwig to Moran, providing 
Moran the benefit of real-time data for use in conference meetings. 

In regard to dependent claims 43-46, claims 43-46 reflect the system comprising computer executable 
instructions used for performing the method as claimed in claims 20, 21, 13, 14, and are rejected along the saint 
rationale 

In regard to dependent claims 47-49, claims 47-49 reflect the system comprising computer executable 
instructions used for performing the method as claimed in claims 17, 18, 22, and are rejected along the same 
rationale. 

Response to Arguments 

5. Applicant's arguments filed 10/27/2005 have been fully and carefully considered but they are not 
persuasive. 

Applicant's arguments are substantially directed to amended subject matter. Accordingly, the examiner 
introduces the Adler reference to teach the amended limitations. 
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Conclusion 

6. Any inquiry concerning this communication or earlier communications from the examiner should be 
directed to William L. Bashore whose telephone number is (571) 272-4088. The examiner can normally be 
reached on 1 1 :30am - 8:00pm EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's supervisor, Heather 
Herndon can be reached on (571) 272-4136. The fax phone number for the organization where this application 
or proceeding is assigned is 571-273-8300. 

7. Information regarding the status of an application may be obtained from the Patent Application 
Information Retrieval (PAIR) system. Status information for published applications may be obtained from 
either Private PAIR or Public PAIR. Status information for unpublished applications is available through 
Private PAIR only. For more information about the PAIR system, see http://pair-direct.uspto.gov. Should you 
have questions on access to the Private PAIR system, contact the Electronic Business Center (EBC) at 866-217- 
9197 (toll-free). 
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